Local convergence of alternating low‐rank optimization methods with overrelaxation
نویسندگان
چکیده
The local convergence of alternating optimization methods with overrelaxation for low-rank matrix and tensor problems is established. analysis based on the linearization method which takes form an SOR iteration a positive semidefinite Hessian can be studied in corresponding quotient geometry equivalent representations. In case, optimal relaxation parameter accelerating determined from rate standard method. This result relies version Young's theorem 2 × $$ 2\times block systems.
منابع مشابه
Fast Alternating Direction Optimization Methods
Alternating direction methods are a common tool for general mathematical programming and optimization. These methods have become particularly important in the field of variational image processing, which frequently requires the minimization of non-differentiable objectives. This paper considers accelerated (i.e., fast) variants of two common alternating direction methods: the Alternating Direct...
متن کاملConvergence Properties of the Symmetric and Unsymmetric Successive Overrelaxation Methods and Related Methods
The paper is concerned with variants of the successive overrelaxation method (SOR method) for solving the linear system Au = b. Necessary and sufficient conditions are given for the convergence of the symmetric and unsymmetric SOR methods when A is symmetric. The modified SOR, symmetric SOR, and unsymmetric SOR methods are also considered for systems of the form DiHt — Cau2 = b¡, — CLui + D2u2 ...
متن کاملOn Local Convergence of Alternating Schemes for Optimization of Convex Problems in the Tensor Train Format
Alternating linear schemes (ALS), with the Alternating Least Squares algorithm a notable special case, provide one of the simplest and most popular choices for the treatment of optimization tasks by tensor methods. An according adaptation of ALS for the recent TT (= tensor train) format (Oseledets, 2011), known in quantum computations as matrix product states, has recently been investigated in ...
متن کاملOn Local Convergence of the Method of Alternating Projections
The method of alternating projections is a classical tool to solve feasibility problems. Here we prove local convergence of alternating projections between subanalytic sets A,B under a mild regularity hypothesis on one of the sets. We show that the speed of convergence is O(k−ρ) for some ρ ∈ (0,∞).
متن کاملLocal Linear Convergence for Alternating and Averaged Nonconvex Projections
The idea of a finite collection of closed sets having “linearly regular intersection” at a point is crucial in variational analysis. This central theoretical condition also has striking algorithmic consequences: in the case of two sets, one of which satisfies a further regularity condition (convexity or smoothness for example), we prove that von Neumann’s method of “alternating projections” con...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Numerical Linear Algebra With Applications
سال: 2022
ISSN: ['1070-5325', '1099-1506']
DOI: https://doi.org/10.1002/nla.2459